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In this paper, we investigate the consistency and asymptotic effi- 
, ciency of an estimator of the drift matrix, F, of Ornstein-Uhlenbeck 

processes that are not necessarily stable. We consider all the cases. (1) 
The eigenvalues of F are in the right half space (i.e., eigenvalues with 
positive real parts). In this case the process grows exponentially fast. 
(2) The eigenvalues of F are on the left half space (i.e., the eigenvalues 
CN| ■ with negative or zero real parts) . The process where all eigenvalues of 

iy>^ ' F have negative real parts is called a stable process and has a unique 
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' not grow. When the eigenvalues of F have zero real parts (i.e., the 

' case of zero eigenvalues and purely imaginary eigenvalues) the pro- 
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first show that an estimator, F, of F is consistent. We then combine 
them to present results for the general Ornstein-Uhlenbeck processes. 
We adopt similar procedure to show the asymptotic efficiency of the 



Key words and phrases: Ornstein-Uhlenbeck processes, stable process, 
drift coefficient matrix, estimation, consistency, asymptotic efficiency. 

AMS subject classification: 62M05 (60F15) 



* (Corresponding author) Stat-Math Unit, Indian Statistical Institute, Kolkata 700 108, 

India. E-mail; gkb@isical.ac.in 

^ JPMorganChase Bank, N.A., Asia Rates Strategy, Hong Kong. Email: 

philip . pk . lee® j pmorgan .com 



1 



1 Introduction 



Multidimensional processes with linear drift parameter have been used for 
modelling various physical phenomena. Among recent papers, works by 
Jankunas and Khasminskii (|12j) and Khasminskii, Krylov and Moshchuk 
(|15j) on the estimation of the drift parameters of linear stochastic differ- 
ential equations (of the form, dXf = AXfdt + J27=i '^i^tdwi{t) and dXt = 
AgXfdt + J27^i ^i^tdwi{t)) can be mentioned. It should be noted that our 
work on Ornstein-Uhlenbeck (OU) processes does not follow from theirs and 
that the methodology used in our paper is also quite different from theirs. 

The motivation for this work comes from Lai and Wei's paper [20] , in which 
the authors have shown the strong consistency of the least square estimators 
of the coefficients of the discrete univariate general AR(p) processes. In this 
paper, we not only show that an estimator (which is the maximum likelihood 
estimator in the special case when A is nonsingular) of the drift parameter 
of the general multidimensional OU process is consistent but also show that 
it is asymptotically efficient. We consider the following SDE representation 
of the OU process: 

dYt = FYtdt + AdWt (1.1) 

with any starting point Yq independent of the Brownian motion {Wt, t >0}. 
Here y is a p-dimensional process, yl is a constant matrix of p x r dimesnion 
and Wt is a r-dimensional standard Brownian motion. Notice that it is 
always easier to estimate A through quadratic variation of the process by 
using Ito's rule. But, estimating F is usually the more difficult task. It is 
generally believed that one needs stationarity of the process to estimate F. 
However, one may observe, dYtYl = F{J^ YtY^dt) + A{jQ dWtYl). Thus, 
we define. Ft = dY^YDU^ YtYldt)-^ = F + AU^ dWtYDU^ YtYldt)-^ 
when ( jj" YtY^dt) is invertible and, in this case, the estimator is unbiased 
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(as the expectation of the second term is zero). We show here that Ft is a 
consistent and an asymptotically efficient estimator of F, irrespective of the 
stationarity (or stability) of the process, provided F and A together satisfy 
a i?j4A'^ii' condition (a), given in Section [21 This RANK condition is essential 
to prove that {J^ YtY^dt) is invertible. We note here, if ^ is a nonsingular 
matrix, the RANK condition automatically holds. In fact, it is also easy to 
see that for a continuous autoregressive process (i.e., CAR(p)), the RANK 
condition holds. 

We also make another assumption, condition (b). It is the distinctness of 
the eigenvalues with positive real parts. However, we point out that this 
condition can be relaxed with a condition (b') and also that if none of the 
conditions (b) or (b') hold it is still possible to proceed with the estimation 
(see the discussion after Remark l3.2p . Notice that the condition (b') holds 
for the drift F in CAR(p) processes. 

The estimation of parameters for the stochastic processes have extensively 
studied (see for example, Feigin [8], Basawa, Feigin and Heyde [6J, Basawa 
and Prakasa Rao [5] , Dietz and Kutoyants [7] , Kutoyants [TTl IB] , Barndorff- 
Nielson and Sorensen [2], Kutoyants and Pilibossian |19j . Jankunas and 
Khasminskii [12], Khasminskii, Krylov and Moshchuk [15] Prakasa Rao [231 
[23] and references therein). Therefore, the estimation of the paramater and 
its asymptotic studies have not been new. However, as far as we know, 
full study of multidimensional OU processes parameter estimation and the 
study of its asymptotics have not been done for the mixed model. Apart 
from showing consistency and asymptotic efficiency for the multidimensional 
(matrix valued) variable that does not follow from that of univariate or 
vector valued case (see, for example, Kaufmann [14j . Wei [2S], Basawa and 
Prakasa Rao [S], Dietz and Kutoyants [3, Kutoyants |171 I18| . Barndorff- 
Nielson and Sorensen [2] , Prakasa Rao [231 HI] and references therein) it also 
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develops new methodology to deal with such cases as is done in Kaufmann 
[H and Wei [25]. 

Our paper is organized as follows. In Section [2l we present the basic as- 
sumptions and the main theorems. In Section [3l we describe the case in 
which the eigenvalues of F have positive real parts. Methodology used here 
is similar to that of Lai and Wei's paper [|20j, while the case in which the 
eigenvalues of F have negative or zero real parts is quite different from them 
and it is discussed in Section [H This case, in fact, combines the three 
cases, zero eigenvalues, purely imaginary eigenvalues and the eigenvalues 
with negative real parts. Details on the rates of growth and so forth for zero 
eigenvalues and imaginary eigenvalues are given in the Appendix. Section [5] 
examines the mixed case for consistency. The section [6] presents the results 
on asymptotic efficiency and some concluding remarks. 



2 Basic Assumptions and the Main Theorem 

We can decompose any p x p matrix F into the rational canonical form 
MF = GM = 

where Gi are pi x pi matrices and Mj are pi x p matrices for i = 0, 1 and 

Po + Pi = P- Rows of Mi and rows of Mj are orthogonal for i ^ j. 

All roots of Go lie in the right half space; all roots of Gi lie on the left half 

space. 
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Then the characteristic polynomial of A is 

f{t) = {t-2f{e + i). 

Thus <t)i{t) = t - 2 and (?!>2(t) = + I are the distinct irreducible monic 
divisors of f{t). After computation, we find that g{t) = (l)i{t)^(j)2{t) = 
{t — 2)^(t^ + 1) is the minimal polynomial of A and thus the companion 
matrices for (pi{t) = {t — 2)^ and (piit) = t — 2 are given by 

-4 

1 4 

Similarly, the companion matrix for (t)2{t) =t^ + 1 is 

-1 

1 0. 

The rational canonical form of A is thus 

/ -4 \ 
1 4 
Ha= 2 
-1 
^ 1 J 



In the example above, the rational canonical form of A is formed by 3 blocks: 

-4 \ / -1 
, 2 and 

1 4 y V ^ ° 

are 2, 1 and 2 respectively. 



Therefore the dimensions of the 3 blocks 
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ASSUMPTION 

(a) RANK (\A: FA: ■■■ : F^-^A 



(2.1) 



(b) The eigenvalues of F, which have positive real parts, are all distinct. 

Observe that, from ([LTD = e^^Yo + Jq e^'^*'"'^ AdWs and thus have a 
multivariate Gaussian distribution with the mean e^* and the covariance 
matrix Jq e^^AA'e^'* . Since Yt is Gaussian it has a positive density if and 
only if the covariance matrix is nonsingular. The RANK assumption which is 
the special case of Hormander's hypoellipticity condition ensures the positive 
density of Yf (for details, see and hence the nonsingularity of covariance 
matrix. 

Following Basawa and Rao ([5j, pp.) it is clear that Jq YtY^dt is nonsingular 
under the RANK assumption. 

Let Fa = [A : FA : FP-'^A]. Then RANK (Fa) = p hy the RANK 
assumption. Consider for i = 0, 1, 

Pi = RANK(MiF4F^i) < RANK(MiFA) < Pi 

where F^^ is the right inverse of Fa- Therefore, RANK (MjF^) = pi for 

i = 0,l. 

Since 



MiFA 



Mi 



A:FA:---: F^^^A 



MiA : MiFA : ■ ■ ■ : MiF^'^A 
MiA : GiMiA G^^'^M^A 

and as the higher power of Gi can be expressed as a linear combination of 

J , (j^j , . . . , Lx ■ , 



RANK 



MiA : GiMiA : • • • : Gf "^MM 



RANK 



MiA : GiMiA : ■ ■ ■ : G^^MiA 



Pi. (2.2) 
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If we transform the process If to Uu = MiYt for i = 0, 1, 

MidYt = MiFYtdt + MiAdWt, 
i.e., dUu = GiUudt + (MiA) dWt. 

From (|2.2p and the argument given above, we conclude that Jq UuUl^dt is 
positive definite a.s. for i = 0, 1. 



We now present our main theorems whose proofs are given in Section [S] 
and in Section El respectively. Throughout the paper, we use Amin(C') and 
Amax(C') to denote the minimum and maximum eigenvalues of a matrix C. 



THEOREM 2.1 Suppose, for the Ornstein-Uhlenbeck process defined in U.l\) . 
the assumptions (a) and (b) hold. Define Ft = {Jf^ dYtYi){jQ YtYfdt)~^ . 
Then 

liminfr^oo^Arnin ^^yfy/dt^ >0 a.s. (2.3) 

and 

Huit^ooFt = F a.s. 



THEOREM 2.2 Under the assumptions of Theorem \2.1[ it follows that 
E{Tt[{Ft - F)E{Ct){Ft - F)'])i/2 = 0(1) as T ^ oo, where Ft is as 
defined in Theorem \2.1\ and Ct = ( f^ YtYldt\ . 



3 Eigenvalues in the Right Half Space 

We consider the case where all the eigenvalues of F have positive real parts. 
In this case, it can be seen that ||1^|| oo exponentially fast as t ^ oo. 
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To introduce the main result of this section we define a Gaussian random 
variable 

POD 

Z = Yo+ / e-^'AdWs. 
Jo 

Since all the eigenvalues of F have positive real parts, it is clear that, 
e~^^Yt = Yq + Jq e^^'^AdWs converges a.s. to Z as t ^ oo. We now 
derive the following results. 

THEOREM 3.1 In addition to the assumptions and notations of Theorem 
\2.1\ assume further that real parts of all the eigenvalues of F are positive. 
Then, 



i^j^ YtYldt^ e"^"^ converges a.s. to ^ = e-^\Z Z')e-^'Ut. 
Moreover, B is positive definite with probability 1. Consequently, 
limT-.oo?'"^ log Amin YfYldt^ = 2Ao a.s. 

limT^ooT-i log An.ax (^j^ YtYldt^ = 2Ao a.s. (3.1) 

Here and throughout the paper, logx means the natural logarithm of x. 
Also, in the sequel we shall let ||x|| denote the Euclidean norm of a p- 
dimensional vector x = (xi, • • • •j Xp ^ ^ 1.6>^ ll^^ll — X X • Moreover, by viewing 
a p X p matrix as linear operator, we define ||^o|| = sup||^||=;^ ||^oa^||- 
Thus, ll^olP is equal to the maximum eigenvalue of A'qAq. Moreover, if 
^0 is symmetric and non-negative definite, then ||^o|| = Amax(^o)- In 
particular, for the companion matrix e~^^ in Theorem 13.11 we have the 
following Lemma. 



LEMMA 3.1 Under the hypothesis of Theorem [3l\ 

log||e^^|| ~ log lle^'^ll ~ AqT, 
and log||e-^^|| ~ log||e-^'^|| AqT (3.2) 
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where we use the notation f{T) ~ CT" to denote Wuit^^T-^ f [T) = C 



Proof. Suppose Re[Afc(F)] > for /c = 1, 2, • • • ,p. Then 

|gA,(F)| ^gRe[A,(F)] > ^ for A: = 1, 2, • • • , p. 

Let Aq = mmi<fc<p Re[AA,.(F)], Aq = maxi<fc<p Re[AA;(F)]. Denote the spec- 
tral radius of F by r(j[F) (cf. [16]). Then 



HniT^oolle^^ll^ = r„{F) = sup;,g^(eF)|A| = exp sup;^g^(^)Re(A) 



and so log | |e 
—XqT since 



FT I 



log 1 1 e 



F'T\ 



AqT. Similarly, log \ \e 



-FT I 



log I \e' 



-F'Ti 



limr^oolle = sup;,g^(e-F) |A| = exp sup;^g^(_^)Re(A) 

Thus, we have the proof of Lemma 13.11 



-Ao 



Proof of Theorem [SHI Let Zt = Yo + Jq e'^'AdWs, then Yt = e^^Zt and 

Zt converges a.s. to Z = Yo+ e-^'AdWs. 

Jo 

Let Bt = Jo e-^^ZrZ^e-^'^dt, 



-FT 



JQ 



e-^'ZTZ^e-^''dt 



< I lie 
/o 

fT/2 



rT 

/ e"-^* (ZT-tZ^_t - ZtZ^) e-^ *dt 
Jo 

^*|| ||e-^'*|| {\\ZT-t\\ + \\Zt\\) \\Zt - ZT-t\\dt 



-Ft\\2/ 



\ZT-t\\ + \\Zt\\)\\Zt - ZT-t\\dt 





+ / lie 

It/2 



-Ft\\2i 



\ZT-t\\ + \\Zt\\)\\Zt - ZT-t\\dt. 



(3.3) 



Since Zt converges almost surely to a finite random variable Z, sup|j>Q} || 
is finite almost surely and for each t > T/2, \\Zt — Zx-tW, being a cauchy 
sequence, converges to zero, almost surely, as T — > oo. Also, by Lemma 
I3.H /o°° I < cxD. Thus, we get, \/uj outside a null set, Ve > 0, 

there exists a Tq^uj) such that ||Zj(w) — Z(<^)|| < e/(l + We'^^W^dt + 
2sup|^>o} ||Zf(w)||) for all t > Tq{lo). Fixing one such lo, for T > 2Tq{uj) we 
have the first integral of (j3.3p . which is less than e and the second integral 
goes to zero as sup|^>o} ||Zt(a;)|| is finite and J^^2 ||e~^*|pc?i — > as T ^ oo. 

Let B = e-^^ZZ'e-^'^dt, then with probability 1, 

\\Bt-B\\ 

poo pT 

< / \\e-^'ZZ'e-^'\\dt+ / \\e-''\ZZ'-ZTZ^)e- 
Jt Jo 

roc fT 

< \\ZZ'\\ \\e~^ '\\\\e~^'\\dt + \\ZZ' - ZtZ'tW \ 

Jt Jo 

— > a.s., as T — > cxd. (3-4) 
Therefore, 



|e-^*|| \\e-^''\\dt 



e"^^ (l^ ^t^/f^*^ e"^'^ converges a.s. to B = e~^^ Z Z' e'^'Ut. 



(3.5) 



To show B = e~^*ZZ'e~^'^dt is positive definite with probability 1, 
observe that Z has positive Gaussian density. Hence P{Z 7^ 0) = 1. Fix an 
iv, such that Z{lj) / 0. Suppose, if possible, 

x' e~^^ Z (uj) Z {uj)' e^^ ^dt^ x = for some nonzero vector x G TZ^. 

Then, for almost all t G (0, T), x'e~^^Z{uj) = 0, i.e., for almost all t G 

00 

(0,T), J2 ^i-l)''x'F''t''Z{uj) = 0. This implies a;'F^Z(a;) = 0, for k = 

k=0 

0,1, ■ ■ ■ ,p — 1. By the assumption (b), J2k=o^kF'' is nonsingular for any 
real number a/, with not all of them being zero. Hence, for any nonzero 
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vector in TZ^, in particular for x, x' X]fc=o o^kF^ is a nonzero vector. In 



other words, for nonzero vector x, X)fc=o ^ki^'F ) is nonzero for any nonzero 



vector {gq, . . . , ap-i). Thus 



X 

x'F 
x'PP-^ 



is a nonsingular matrix. Hence, 



/ X' \ 
x'F 



Z{uj) = imphes Z{ijj) = 0, which is a contradiction. Thus, 



y x'FP-^ J 

we arrive at a contradiction since Z has a positive Gaussian density and 
hence Z cannot be equal to zero on a set of positive measures. Therefore, 
we conclude that B is positive definite with probability one. 

To prove ()3.ip . we state the following elementary results (for the proof, see 
Lemma 2 of 



LEMMA 3.2 Let A, C be pxp matrices such that C is symmetric and non- 
negative definite. Then 

Amax(C')Amin(^^ ) ^ ^raini^C A ) > Amin(C) Amin(^^ )• 



We continue the proof of (j3.ip of Theorem 13.11 From Lemma 13.21 we get, 

logA^in ^^ytr/dtj < logA„,ax e-^^ (^j\tY;dt^ e-^'^ 

-logA^ax(e-^^e-^'^) 
~ 2AnT. 
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Also, 



YtYfdt] > losA, 



-FT 



F'T 



Therefore 



2XoT. 



£ YtYtd^j = 2Ao a.s. 



On the other hand, 



Also, 



log K..(^J^YtY^dt^ < logA^ax e-^^ (^j\tYldt^ e-^'^ 

+ logA^a.(e^^e^'^) 
~ 2Aor. 

\og \^^^{^j\tYldt^ > logA^in e-^^ (^^""yty/dt^ e-^'^ 

, . / -PT -F" 
- log Amin [e e 



2Aor. 



Therefore 



liniT^oo^log Amax 



YtYldt^ = 2Ao a.s. 



Hence, we have the proof of Theorem 13.11 ■ 

COROLLARY 3.1 Under the same assumptions and notations as in Theo- 
rem\3.1[ 



(i) hniT^oo / \\e-^^Yt\\dt = We'^^' Z\\dt < oo a.s. (3.6) 
Jo Jo 

(ii) ^(^l^dW,Y^e-^'^ = 0{T-y'). 
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Proof, (i) Given e > 0,Va; outside a null set, 3ro(ti;) such that 
\\Zt-Z\\<e yt>To{uj). 

For T > To{uj), 

r\\e-FiT-t)Zt\\dt- r||e-^(^-*)z||dt 
Jo Jo 



Jo 

< r||e-^(^-*)|| \\Zt-Z\\dt 
Jo 

^(^-*)|| \\Zt-Z\\dt+ I 
Jj 



'FiT-t)n \\Z,-Z\\dt. 



As r ^ oo, the first term tends to since | |e *^ 1 1 ^0. The second term 
also tends to since Zt ^ Z and /^(^^ ||e-^(^-*)||fit < /J' ||e-^(^-*)||(it = 
lo — /o° which is finite. Therefore, 

limT^oo / \\e-^^Yt\\dt = limT^oo / \\e-^^^-'> Zt\\dt 
Jo Jo 

= hmr^oo r||e-^(^-*)Z||dt 

JO 

= / ||e-^*Z||(it, 

JO 

which is finite almost surely, by Lemma 

(ii) Let Mt = ^ /q dWsY^^ e~^"^ , which is a square integrable martingale for 
< t <T, with quadratic variation, 

where Ct = jQYsY!.ds. By Karatzas and Shreve (cf [13] pi 74), 

dW,Y:\e-^'^ = Mt = B<M>, 

= O (^A^ax (e-^^^e-^'^) v/lnln A^ax (e-^^^e-^'^) 
= 0(1) 
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since for t < T, \\e ^'^Cte ^'^\\ < ||e ^'^Ct& ^'^\\ B, almost surely, 
as T — > oo and B = 0(1). Therefore, 



This completes the proof of Corollary 13. 1[ ■ 
REMARK 3.1 

If all the eigenvalues of F have positive real parts, we can relax condition 
(b)by 

p-i 

(6') ^ OfcF^ being nonsingular for any reals ai,...,an with at least 

k=0 

one of them being nonzero. (3.7) 

Notice that (b') could hold even if all the eigenvalues of F are equal (say, 
Ao), but the degree of the minimal polynomial of F and the degree of the 
characteristic polynomial of F are equal. 



REMARK 3.2 Suppose, assumption (h) does not hold. One can still estimate 
the eigenvalues of F. 



Let the characteristic polynomial of F be given as (t>F{x) = aon^=i(x — 
XiY'^n^j^i^x'^ + bjX + CjY^ where Aj are the real roots of multiplicity pi and 
+ hjX + Cj are the irreducible polynomials giving the complex roots with 
multiplicity qj and oq is a constant. Let the minimal polynomial of F be 
given by iPf{x) = H'^^iix — Ai)^*n^-^j^(x^ + bjx + CjY^ with rj < pi and 
Sj < qj. If = Pi and Sj = qj for all i, j, then the degree of the minimal 
polynomial of F and the degree of the characteristic polynomial of F are the 
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same and the assumption (b') holds and our results follow. If some of the 
TjS are less than piS and/or SjS are less than qj, then, (b') does not hold for 
F. However, in that case, one can transform F in the rational canonoical 
form as 



/ 


Jl 






/ 


Bi ■ 


• 


• 


• 





\ 


/ 


Jl 






/ 


BiJi 


\ 












■ 


. 


• 


• 























Jk 
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• -Bfe 


• 


• 

















BkJk 






Ki 




F = 




• 


• 


Ci • 


• 









Ki 








CiKi 














• 


• 


■ 


. 























Ki 








• 
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• 


• Ci 









Ki 








QKi 




V 


L 


) 




I 


• 


• 


■ 


■ 


D 


J 


\ 


L 


) 




I 


DL 


J 



where Jj, Kj and L are rectangular matrices of full row rank, (pi — ri), {qj — 
fi + Z]j respectively, and D \s a. square matrix of the dimension 
the same as the degree of the minimal polynomial of F (i.e., same as Ti+ 
^jSj)). For each j, Cj is a partitioned diagonal matrix (i.e., only the 
diagonal blocks are nonzero blocks), each block is of dimension 2x2, and its 
diagonal block matrices are identical and repeating exactly {qj — Sj) times 
and have the characteristic polynomial + hjX + Cj, and, for each i, Bi is 
a diagonal matrix with diagonal entries consisting of the real characteristic 
root Aj repeating exactly (pi—Vi) times. Thus, we can work with D instead of 
F. For D the assumption (b') holds, since the degree of minimal polynomial 
of D is same as that of F and, consequently, the degree of the minimal 
polynomial of D is the same as the degree of the characteristic polynomial 
of D. Estimation of D can be done using the SDE of LYf. For Bi and Cj, 
one can consider each one separately and transform Yt to Jjlj and KjYt 
and use the SDE of any component of JiYt (as it has the Markov property) 
to estimate Aj and the SDE of the first two (or, any (2m-l)th and 2mth) 
components of KjYt together, as they have the Markov property, to estimate 
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a diagonal block of Cj. Hence the assertion in the last remark. 



4 Eigenvalues on the Left Half Space 

In this Section, we study the asymptotic behavior of OU processes where the 
real parts of all the eigenvalues of F are either zero or negative. Unlike the 
exponential rate of growth for ||lr||, Xma.x{Jo YtYt dt) , X^ninUQ YtYldt) in 
Theorem l3.1l and Corollarv l3.1l for the the process where all the eigenvalues of 
F have positive real parts, the following theorem shows that these quantities 
grow at most polynomially fast in t for these processes. 

For stable processes Yj (i.e., eigenvalues of F with negative real parts), we 
know from Basak and Bhattacharya [1] that 

ly^^-yj^l^O a.s. as t^oo. 

Therefore, the property of Yt starting at x is the same as that from 0. Hence, 
without loss of generality, we can assume that 10 = 0. 



THEOREM 4.1 Suppose, for the Ornstein-Uhlenheck process defined in 

the RANK condition \2. 1\) holds and all the eigenvalues of F have negative 

real parts. Then 

liminfT^^^X^in (^J^ YtY^dt^ >0 a.s. (4.1) 



Moreover, 

rT 







YtY^dt] = OiT) a.s. (4.2) 
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Proof. To prove ()4.ip and (j4.2p . consider each component Y^^Y^ of li, 
i,j = 1, • • • ,p. Let vr be the invariant distribution of Y . Then by the Strong 
Law of Large Numbers, 

r 

T 

which fohows, afortiori, by the Law of the Iterated Logarithm by Basak [3]. 
Therefore, 

T, 

which is positive definite a.s. Therefore, 



- / YlYj^dt E^{Y'Y^) < oo as T ^ oo, 
T Jo 



/ YtYldt ^ E^{YY') = e^^'AA'e^^du, 
Jo Jo 



liminfT^oo^Amin (^j^YtYldt^ > 
and \^.^^(^j\tYldt^ = 0{T) 



a.s. 



Hence, the proof. 



REMARK 4.1 



(i) It is not difficult to see that for stable Yj, for any m > 1, E sup^_]^<«^(l^'Pl( 
is bounded uniformly over k. Hence, it would follow, for any 6 > 0, 

\\Yt\ \ = 0(t2k+'5) 

(ii) On the other hand, since 1^ — > y in distribution and Y is finite with 
probability one, one obtains Yt = Op{l). 

COROLLARY 4.1 With the same notations and assumptions as in Theorem 
J} let Ct = JoYtY^dt. Then 

(i) ||C-^/^|| = 0(r-i/2), a.s. 

(ii) limT-*ooYxC^^YT = a.s. 
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Proof, (i) Since liminfT_^oo7'Amin(C'T) > a.s. from (j4.ip . therefore 

WCt^'Y = Amax(Cr') = , ]^ . = 0{T-') a.s. 
(ii) By the previous remark HTT] (i), we note that, 

Wy^c^'YtW < ||1t||'||Ct'II 

Hence, the proof. ■ 

THEOREM 4.2 Suppose eigenvalues of F have either negative or zero real 
parts (i.e., the eigenvalues are on the Left Half Space, which includes zero 
eigenvalues, purely imaginary eigenvalues, eigenvalues with negative real 
parts). Then, 

YiuiT^^Yi^(^j\tYldt^ Yt = Q a.s. 
To prove Theorem 14.21 we need the foUowing lemma: 

LEMMA 4.1 Let e > 0; define = F - eL and dY^ = F^Y^dt + AdWt. 
Then ^ In [(yy)'(Cj.)~^(l^)] is bounded below, almost surely, uniformly for 
large values of T . 

Proof. Let Y^ = m^t- Then we have 
or jointly, 
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Since all eigenvalues of 
stable. Therefore, 





and 



1 
T 



T I Yi 



have negative real parts, 



a.s. for some 5 > Q 



Yi 



IS 



dt 



is positive definite (since the RANK condition holds here as well) and it 
converges almost surely to some positive definite constant matrix as T ^ oo. 
Therefore, (Cj.) and (Cf^) have the same order where Cj. = Jq Y^Y^dt and 
= YlYldt. Hence 



0(1) a.s. as T ^ oo. 



(4.3) 



By Corollary HTIl 



lim- 



T^oo 



(y^)'(c^)-^(y^) 



\iinT^^{Yi)'{C'T)-\Y^) 



a.s. and 

limT^oo(i^^)'(C'T)"H^^) = a.s. 



Consider 

d_ 

de 



> 



{Yfy{c^r\YS) 



2{Y^y{C^r'Y^ + {YSy-{C^) 

2m'ic^)-'Y^ - (Y^nc^)-' 



-lye 



d_ 

We 



(Ysnc^rHYS) 

■T 



1/2 



(YSYiC^rHYS) 



1/2 



-{Y^ncp-' 



(yj)(yj)'a!n+ / iY:)iY:ydu 

Jo 



T 



(C 



-lye 
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> -2 


(y^)'(c^) 




1/^ 




1/2 






-2 


(y^)'(c^) 




I 


T 




nl/2 




^ du 


> -2 


(i¥)'(Cf) 






1/2 






-2 




''m 


.J 


f 

'0 




r {nnc^)-HY:)du 

Jo 


= -2 










1/2 






-2 


"(y^)'(c^) 






+ Tr[(Cf)(C^)-i] 









Therefore, 



^ 1 



iY^nC^)-\Y^) 

I d_ 



{Y^nc^r^Y, 



T) 



> 



mic^rHY^) 



1/2 



(Ysnc^r'iY^) 

p + Tr[(Cf)(C^)-^ 



_{Y^y{C^)-^{Y^)_ 

which is bounded below (by a negative number possibly depending on e) uni- 
formly for large values of T by (j4.3|) and using the fact that both {Yq^y{Cj^)~^{Yj,) 
and (y^)'(C'|,)~^(y^) have the same order and the latter has the order as 
that of {Y^y{C^)-'^{Yf). Hence the proof of LemmaiH ■ 



Proof of Theorem 14.21 Let = F — el, e > 0. Since all eigenvalues of F 
are on the left half space, the real parts of all eigenvalues of F'' are negative, 
i.e., is a stable process. By Corollary 14. 11 

iimT^oo(yc^)'(cf)-i(y^) = 0. 

Let /(e) = ln(l^)(C|i)^"'^(y^). Fix an ei > 0. / is a continuous function 
on [0, ei] and is differ entiable in (0, ei). Then by the Mean Value Theorem, 
there exists an eo G (0, ei) such that 



/(6i)-/(0) = 6i^/(e) 



e=eo" 
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That is, 



(4.4) 



which is uniformly positive (i.e., bounded away from zero) for large values 
of T by Lemma 14.11 Since 



by g3I) 



limT^ociYSYiC^niY^) = a.s 



Uuit^ooYtC^t^Yt = a.s. 



Hence the proof of Theorem 14.2 



COROLLARY 4.2 With the same assumptions and notations as in Lemma 
in 



\Cr 



-1/2, 



Proof. Consider 
d 



de 



TV[(C^)- 



-2Tr 



T r 



(Y^mydt (c 



> -2T¥(cf)-w {Y:nc^)-\n) {Y^nc^r\Y^) 



1/2 



1/2 



du 



> 



-Tr(C| 



(n)' ic^rHY:)du + r iY^nc^r\Y^)du 



Tr(C^)-i (Tr \{C^)-^C^ 



+ Tr 



(Cf)-i(C^) 



Hence |-lnTr[(C; 



> 



Tr 



(Cy) +p) which is bounded below 



(by a negative number possibly depending on e) uniformly for large values 
of T. Therefore, as in (j4.4p . by the Mean Value Theorem, 'rr[(C'T)~^] 
uniformly positive (i.e., bounded away from zero) for large values of T. Since 
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Tr[(Cf = O(T-i), we have 0(Tr[(Cr)"^]) < 0{Tr[{C^)-^]) = 0{T-^). 
Again, as for any positive definite matrix Kt, 0{\\Kt\\) = 0{Ti[Kt))-, we 
obtain by Corollary O^i) , \\{Ct)-^/'^\\ = \\{C't)~^/'^\\ = 0(r-i/2). Hence 
the result. ■ 

REMARK 4.2 

It is clear from the arguments in the above corollarv 14.21 that, for the eigen- 
values of F on the left half space, 

;^Amin(CT) = — — 1- > 0, 

almost surely, uniformly for large values of T, since T\raa.^(C^^) = T\ |C-^^| | < 
T 0{T'^) = 0(1) a.s. 



5 General Ornstein-Uhlenbeck Processes 

For the Ornstein-Uhlenbeck process defined in (II. ip with RANK condition 
(12. ip . we have considered the case in which all the eigenvalues of F have 
positive real parts and the case in which all the eigenvalues of F have zero 
or negative real parts (i.e., zero eigenvalues, purely imaginary and the eigen- 
values with negative real parts). Now we combine these cases to discuss the 
mixed model in which F can be decomposed into rational canonical form as 
follows: 

MF^GmJ'^'' » Umo\ (OoM„\ 

where all the characteristic roots of Go lie in the right half space and all the 
characteristic roots of Gi lie on the left half space. Let 

\Uu ) \ Ml J 
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Then 

d\ 1 = MdYt = MFYtdt + MAdWt= | ^ \ I ^ot i ^ 



Also, 



dWtvi^ M' 
and M (^J^ YtY^dtj M' 



lodWtUi, 

!^UotUl,,dt Jo'UotU[,dt 
j^UuU',,dt j;[UuU[,dt 



Define, Cit = Jq UitU[^dt. We now derive the following result. 



LEMMA 5.1 Suppose, for the Ornstein-Uhlenbeck process defined in U.l]) . 
the RANK condition \2.1\) holds. Then 



DtM {^j^ YtYldt] M'D't 



B-^ 



/p, 



a.s. (5.1) 



where B is defined in Section\^ (before ^3.4^ ), Ip^ is a pi- dimensional iden- 
tity matrix and 



Dt 



c-^/' 



Proof. Observing (|5.1|) . we obtain, by Theorem 13. H that 
lim-jn^ooe"*^""^ ^ J UotUQ^dtj e"*^"^ = B is positive definite a.s. 

Again, = C^r^^'^CixC^r^^^ = Lp^. Hence, the proof is complete once 

we show e~^°^ {Jq UotU{^dt)C^r^^'^ —>■ Op^xpi matrix almost surely, as T ^ 
oo. Notice that, by Corollarv 13.11 



rT 

liniT^oo / We-^^^UotWdt < oo a.s. 
Jo 
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and from Theorem 14.2 



\imT^ooU[rpC^r^UiT = a.s. 

Therefore, for all lo outside a null set, and for any given e > 0, there exists 

To{uj) > such that for ah t > To{uj), ([/{^Cf/f/it) V2 < e/{limT^oo Jo \\e~^°^Uotiuj)\\dt). 

Hence 

rT 



Jo Jo 



dt 



< 



^otW IIC'iT Uit\\dt 



T 
To (a;) 



C-^'^Uit\\dt 



As T — > cxD, the first term goes to since To(w) is fixed. The second term 
is less than e by the choice of Tq[lo) since Cu is increasing in t (in the sense 

— 1/2 

that Cit2 — Cit^ is positive definite whenever t2 > h) and HC^^j. f/it|| = 
{U[^C^^Ult)^/'^ < (C/{iCf/[7it)i/2. As e is arbitrary, the proof is complete. 



We now observe that. 



Ft- F 



T-^'^A yj^ dWtYl^ M'D't 
x{T^/'^DtM) 



DtM i J YtYldt J M'D't 



and 



T-^/'^A Ij^dWiVn M'D't 



T-^/^e-G^^{j;[UotdW[)A' 
T-'"C-^'\S^ UudWDA' 



The first term T-^/'^A dWtU^il) e-^o^ = 0{T-^/'^) by Corollary [STjii) . 
To show the remaining terms converges to 0, we prove the following The- 
orem. This theorem is in the spirit of Theorem 2.2 of Wei [25], which is 
presented for the discrete case. 
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THEOREM 5.1 



a.s. as T — > oo. 



To prove Theorem 15. 11 we need the fohowing lemmas. 



LEMMA 5.2 Fix to > 0. Then, 
rT 



Jto 



a.s. as 



oo. 



Proof. Notice that, 



d 



j^log\Cu\ 



'It I — '^it'-^it ^it, 

where |Cit| is the determinant of Cu- Observe that, Gi can be further 
decomposed into a rational canonical form as follows: 



/ Mil ^ 

Mi2 
V Mi3 J 



Gi 







\ 


^ Mil \ 


' GiiMii ^ 




Mi2 


= G12M12 


/ 


Mi3 J 


\ G13M13 j 



Gil 
G12 
\ 

where all the characteristic roots of Gn have negative real parts, those of 
G12 are purely imaginary and those of G13 are zero. For i,j = 1, 2, 3, define 
Gitij = lo UiisUL^ds, where 



^ Uiis \ I Mil \ 

Ul2s 

V Ui^s ] 



U: 



Is- 



M12 

V Mis J 

ThusCit = ((City)). ^.^-^ 2^3, and hence |Cit| < |Citii| jCiml |Cit33|. There- 
fore, by Theorem UTT] in Section|3]and Theorems l7.ll and l7.2l in the Appendix, 
one obtains 

rc/{,cr/^i,dt = iog"^^^" 

Jto 



c 



1*0 I 



:0(iogr) 
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a.s. as 



00. 



Hence, the proof. 



We observe that, from Lemma [5121 if we let g(T) = f^^ U{^Cn^Uitdt, then 
g{T) t oo as T t oo almost surely. Also, E(\og \Cit\) = log(Ai(Cir))) 
= E.i^(log(A.(CiT))) < Eilog{E{X,{C,T))) 

< pilog{E{X„,axiCiT))) < pilogjQ E{\\Uit\\'^)dt. It is clear that, for the 
eigenvalues on the left half space, £'(||[/ij|p) is at most 0{t^)^ i.e., it grows 
at most like a polynomial in t. Thus, -E(log |Cit|) = 0(log T) as well. Hence, 
using integration by parts, we obtain, 

„i^j-V[fi^\_^^ (5.2) 

LEMMA 5.3 Let Mix = dWtU'n. Then, under the hypothesis of Theorem 

EH 

1 —1/2 

MixCrp ' — > in probability. 



ri/2 



Proof. Notice that Mn is a martingale with respect to the filtration 
{Tt]t>o where Tt = (j{Ws : < s < t}. Define Nit = f^dWiU'^ = 
MiT — Mit^. Then, for T > ti, Nix is also a martingale. Define Vt = 
Tr[Cu^M[tMu]/t and Vt = Tv[Cu^ N[tNu]/t. Since H^MitC^^'/'P < 
Vt < 2Vt + 2TT{C{^M[t^Mu,]/T and Tv{C^^ M{t^Mm]/T 0, almost 
surely, as T ^ oo, it is enough to show that Vt ^ 0, in probability, as 
T — > oo and this would be immediate once one shows E{Vt) ^ as T ^ oo. 
Now use Ito's Lemma to get 



dV, 



IV (cr/d(iV{,iVii)) + Tr [{Ci,')N[tNu 



dt 



t t 



Vt 

dt (5.3) 



where = —Ci^ (^^*) ^i*^ ~ ~^ it^^uU'itC which is non-positive 
definite. Thus, 
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TV 



-UitC{t^N[tNitC^t^Uu < 0. Therefore, by ^ and 
applying the Ito's Lemma again, one obtains 
rT 



Vt < 



Tr [c^MKNit)) It 
Tr [Cl^ {{^dN[,)Nu + KA^^^u) + {dN[^{dNu)i) It. 



Define t^, = inf{t > ti : > n}, then 



(5.4) 



Since Vtat„ and U[^C^^^Uit are non-negative, by Fatou's Lemma and the 
Monotone Convergence Theorem, 

- Jt, (logt)i+" 

Now, by the argument in (|5.2I) . one has Um supj-j^^oo} EVp < aCt^°'. As ti 
can be taken to be arbitrarily large, we have the result. ■ 



LEMMA 5.4 Let Vt = Tr[Ci/M{(Mit]/t. Then, with the same assumptions 
and notations as in Lemma[573[ 



/ E[E{dVt\J^t)]'^ <^. 
Jti 



Proof. Applying Ito's Lemma on Vt, 



dVt 



(Tr [C{t^d{M[^Mu] 



+ Tr 



dt 



t 



t 



where C 



-1 
It 



C^^^U^tU'uCu' and 



Tr 



C^^\M[tMn] 



-U[tCu'M[tMuCu'Uit < 0. 
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Therefore, 



EidVtlJ't) < ^([Tr(C7-i(i(M(,Mu))] /t \ Tt 

= S ([Xr (Cf/[(dM{,)Mu + M[,{dMu) + {dM[t){dMu)])] /t \ Tt 
{^v(ci^{dM[^){dMu))\lt\Tt 



E 



E (^-^^dt I t: 



Thus, 



Since U'uC^t^Uit > 0, by Fubini's theorem and by (fOjl 

/•oo /-oo roo Tjl C~^TJ^, 

/ [E{dVt\m'^ = E / < E / " " " dt < oo. 

Jti Jti Jti t 

Hence, the proof. ■ 

Proof of Theorem 15. IL Define ^4^^' = {maxti<t<TVt > 6} and Ht^ = 
{Vt-^ < e} for any e > 0. Then, using the Lenglart Inequahty (cf. Karatzas 
and Shreve [13] p30 or Lenglart [22]), 

rT 

Hi 



P(4'^n/7t,) < ^EVtjH,^ +^ E [[E{dVt\:Ft)]+lH,,^) . 



Therefore, 



< P {HfJ + P (a's''^ n Ht 



< P {HI) + [[E{dVt\:Ft)]^ Ih,, 

< P{Hl) + - + -J^ E[E{dVt\:Ft)]+, 
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which is finite since E[E{dVt\J^t)]^ < oo by Lemma |5.4[ Therefore, as 

T ^ oo, 

P (limT^oo4''^) = limT^ooP (4''^) 

f 1 

< P[Hl) + - + -j^^ E[E{dVt\Tt)]' . 

Thus, 



hmsupt^_^o^ P (limT^oo^''^) < ^ 



5' 



Since this is true for all e > 0, 



limsuptj_^oo P (limT-^oo^^'^) = 0. 



This implies, 

rT 



.0 a.s. 



Hence, the Theorem. ■ 
Proof of Theorem 12.11 From Lemma [STTl we have He"*^""^!! = 0(e~^°^) 

and, from Corollary 14. 2^ we have ||C]^'r''^|| = 0{T^'^/'^) almost surely, as 
T — > oo. Thus, 

\\T^I^-DtM\\ = Ti/2||^|| (||e-Go^|| + \\C^t''^\\) = 0(1) a.s. as T ^ oo. 

Therefore, from (|5.ip . Corollarv lS.lT ii) and Theorem lS.l^ we have limy^oo Pt 
F a.s. 



To show that ()2.3p holds, we observe that, for the eigenvalues of F in the 
right half space p.3p follows from Theorem 13.11 and, for the eigenvalues of 
F on the left half space (j2.3p follows from arguments in Corollary 14.21 and 
Remark 14.21 For the mixed model, we observe 

( YtYldt\ = DtMT^tM'D'j^ 
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where hmj^^oo is a.s. positive definite. Thus, by Lemma [321 



At, 



YtY^dt 







0(Amax(^T^r)) = 0{T-'] 



Therefore, the Theorem follows. 



6 Asymptotic Efficiency 

In this section we would like to show that our estimator for the drift matrix 
F is asymptotically efficient even if the underlying process is not necessarily 
stationary (stable) . For matrix- valued estimator there several ways to define 
asymptotic efficiency (see Barndorff-Nielson and Sorensen [2], for details). 

The result is already known in one-dimensional case and for vector-valued 
parameters (e.g., O [71 [181 [23] and references therein) when the processes are 
not necessarily stationary. For multi-dimensional matrix-valued case, similar 
things can be proved once the asymptotic efficiency is properly defined for 
the matrix valued estimator. 



Observe that, when AA' is nonsingular, the log-likelihood of F, (see [5], 

JiY^F'iAA'r'dYt) - 



pp. 213-214), on [0,r] is defined by, LAiF) = Jf[ {Y^ F' {AA'y^dYt 



(1/2) J^{Y^F'{AA')-^FYt)dt. Thus, 



dLAiF) = tr 



dF 



YtdYl^ {AA')-^ - dF (^j^ YtYldt^ F'{AA')-^ 



Therefore, dLA{F)/dF = 

( dYtY^'j Jq YtYldtj . When AA' is not nonsingular, the log-likehhood 
of F cannot be written explicitly. Therefore, M.L.E. of F could not be 
achieved. However, we would show that the above estimator is asymptoti- 
cally efficient under the assumptions of the section 2. 

We show that E{Tt[{Ft - F)E{Ct){Ft - F)']^/^ = 0(1) as T ^ oo. 
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Let St = [Jq AdWtY^^ , and Ct = [jo YtY^dt^ as before. We use Tt[{Ft - 
F)E{Ct){Ft-F)'] = Ty[StCt^E{Ct)C^^S'j] < Tv[StCt^ S't]Tv[Ct^ E{Ct)] 
to prove the following result. 

Proof of Theorem 12.21 

Case 1: Eigenvalues of F are in the positive half space. 
Observe that, TV(5rC^^5^) = 

TT{STe~^ CTe~^ S'rp). Since Stc"^ is a Gaussian pro- 

cess and its mean zero and variance e~^^ E{CT)e~^'^ converges (in fact, 
to E{B)) as T — > oo, STe~^"^ converges to a finite Gaussian random vari- 
able in distribution. Also, from Theorem (j3.ip . as T — > oo, e~^'^ CTe-~^'^ 
converges almost surely to B (which is positive definite with probability 
one). Thus, we obtain Tr(5'Te~^ ^(e~^^CTe~^ ^)~^e~^^5ji) converges in 
distribution to finite random variable with finite expectation. 

Now, 1:i{C^^E{Ct)) = Tv{{e-^^CTe-^'^)-^{e-^^E{CT)e-^'^)), and from 
Theorem (jS.ip . as T ^ oo, {e~^^CTe~^'^)~^ converges to almost 
surely. Also, e-^"" E{CT)e-^'^ = e~^'Y^Yie~^''dt+ te-^' AA' e-^''dt, 
which is finite as T — > oo. Thus, it remains to show, as T ^ oo, E(e~^^CTe~^ 
converges to E{B~^) (which is finite). First observe that, Zi-Yq = /q e~^''AdWs 
is a symmetric (Gaussian) martingale and with E\Zt — loP 1^ E\Z — loP < 
oo. Thus Mz = maxo<j<oo('^t — Yq) exists and has finite expectation. Also, 
(by symmetry) mz = mino<j<oo('^t — Yq) exists and has finite second mo- 
ment. For symmetric matrices Di and -D2) define, Di > D2 if Di — D2 is 
non-negative definite. Therefore, 

c-^^Ctc-^'^ = r e-^'ZT-tZ'T.te-^''dt 
Jo 

> f e-^\mz + Yo){mz + Yoye-^''dt 
Jo 
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Jo 

for all T > Tq, for some Tq > (Tg may be taken to be 1). Thus, 
{e-^^CTe-^'^)-^ < e-^\mz + Yo){mz + Y^)' e-^'Ht)-^ for all T > 
Tq. Since right hand side has finite expectation, using dominated con- 
vergence type theorem deduce E{B~^) = limT~,oo E{e~^^CTe~^"'")~^ < 
EUo° e-^\mz + Yo){mz + Yoye-^'^dt)-\ Therefore, E {Tr {0^^ E{Ct))) is 
finite and hence E{Tt[{Ft - F)E{Ct){Ft - F)'])i/2 = o{l). 



Case 2: Eigenvalues of F are on the left half space. 



When all the eigenvalues have real parts negative, by ergodic theorem, 

limT^oo t^Ct = j;^ e^^AA'e^'^dt = limr^oo E{^Ct). Thus, 

limT^oo E{Ti{StCt^S^)) =limT-.oo E{Tt{^S'j.St{J^ e^^AA'e^'^dt)-^)) = 

p, i.e., of 0(1). Also, limr-.oo E{TriCT^ E{Ct))) = limT-.oo E{Tr{{^CT)~^E{^CT))) 

p. Therefore, E{Tv[{Ft - F)E{Ct){Ft - F)'])'^/^ = 0(1). 

Zero and purely imaginary eigenvalues. 

When the eigenvalues are either all purely imaginary or all zero, replace F 
hy F — el = F'^ , as it is done in Section [U get the result as above by ergodic 
theorem. 



Now, as in Lemma |4.H consider 
d 



de 



TrEiiS^TnC^rHS^T)) 



2Tr^((Sf )'(Cf ) + Tr^((5f )'^(Cf 



2TvE{{S^y{C^)-^S^) - Tr^((5^)'(C7f ) 



1/2 



d_ 

Fe 



1/2^ 
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> 



> 



-2 {^E 
-2E 

-2 
-E 



Tr((5^)'(C^)-i(5^)) 
TV((5f)'(Cf)-i(5f)) 

Tr((5^)'(Cf)-i(5f)) 
TV((5^)'(Cf)-i(5f)) 



1/2 



E 





1/2 



Tr((5f)'(C^)-i(5^)) 

1/2 



1/2 



1/2 



1/2 



du 



E 



Tr((5^)'(C^)-^(5^)) 



JO 



S ([tV((5^)'(C|,)-1(5^))] + TY[(C^)(C^)-i 



1/2 



Therefore, 



oe 



TV((5|.)'(C^)-i(5f)) 



OTr((5f.)'(Cf)-i(5^)) 



'1 5 



TY((5f,)'(C^)-i(5f,)) 



> 



ETijiS^^YiC^rHS^^)) ] ^'^ _ E ([Tr((g^y(C|,)-i(5!.))] [p + Tr [{C^){C^)-' 
ETii{S^^y{C^)-HS^^))\ E [Tr((5^)'(C7^)-i(5^))] 

which is bounded below (by a negative number possibly depending on e) uni- 
formly for large values of T by (fOj) and using the fact that both TrE{{S^y (C^y^iS^)) 
and TvE{{S^y {C^)~^ (S^)) have the same order and the latter has the order 
as that of TtE{{S^y {C^)-^SI^)). 

Now as in the argument in consistency part, since all eigenvalues of F are 
on the left half space, the real parts of all eigenvalues of F^ are negative, 
i.e., y/ is a stable process and 

limT^ooTVE((5T)'(C^T)"'('5r)) = 0(1)- 



Similarly, to get a upper bound, consider 
d 



de 



T,Emnc^r\s^r)) 
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Q re 



< 2E 
+TtE 

< 2{e 
+2E 

< 2(e 
+E { 



^((^t)'(C^t)-'(^t)) 

T 



1/2 r 



l/2^ 



TV((5^)'(C^)-i(5^)) 
TV((5f)'(Cf)-i(5^)) 

TV((5^)'(Cf)"i(5^)) 
TV((5^)'(Cf)-i(5^)) 



JQ 



1/2 



1/2 



1/2 



TV((5^)'(C7f)-i(S^)) 

1/2 



1/2 



JO 



2 (£; [TV((5^y(Cf)-i(5^))])'^' (ii; [TV((5|.y(Cf)-i(5^)) 
+S ([TV((5^)'(Cf ))] [p + TY[(C^)(Cf )-i 



1/2 



Therefore 
d 



de 



InE 



TV((5|.)'(Cf)-i(5^)) 
1 d 



< 2 



OTr((5^)'(C7f)-i(5^)) 
"OTr((5^)'(Cf)-i(5f)) 



i?TY((5^)'(C^)-i(5|.)) 



1/2 



E 



+ 



;TV((5^)'(C^)-1(5^)); 
s([Tr((5|.)'(C^)-i(5|.))] 



p + Tr iC^){C^) 



E[TT{iS^^y{C^)-HSm 

which is bounded above (by a positive number possibly depending on e) 
uniformly for large values of T by (j4.3p . 



As in the proof of Theorem^ let /(e) = lnTTE{{S^){C^)-^{SI;,)). Fix an 
£i > 0. / is a continuous function on [0, ei] and is differentiable in (0, ei). 
Then by the Mean Value Theorem, there exists an ep € (0, ei) such that 



/(6i)-/(0) = 6i^/(e) 



e=eo 
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That is, 



- exp < ei^/lej \e=eo r ) 



(6.1) 



TrEiS'rpC^^ST) 

which is uniformly bounded and positive (i.e., bounded away from zero and 
infinity) for large values of T Kued above. Since 



limT-.ooTVE((5^)'(C^)-'(5^)) = 0(1) 



by (lET 



limT^ooTiE{S'TC^^ST) = 0(1). 



Mimicking the above argument, find 



-TV l^E (^(Cf )-i 
+TV (E{{C^r')E 



'"(yj)(yj)'dn+ finw^ydu 

JO 



(Cf )-i j E{G_ 



T) 



Jo 



> -2E 



-2E 



T,{{C^^)-'E{C^t)) 

T 



1 1/2 r 

{Y^)'{c^T)-\yu)\ \iyu)'{c^Tr\yu) 



1 







1/2 



{y.^j{e{{c^t)-')){y^) ' {Y^ymc^r')){Y:) 



1/2 



du 



> -i?([Tr((C^)-ii?(Cf))] [p + Tr[(Cf)(Cf)-i] 



-2^ 



Tr(i?((C^)-i))(C^) - Tr(ii;((Cf)-^))(Cf) 



1/2 



1/2 



> -E[[Tt{{C^)-^E{C^))] [p + Tr[(Cf)(Cf)-i] 

1/2 



2 (TV £;((Cf)-i)S(Cf 



Tr ^((C7f)-^)S(C7f 



1/2 



Therefore 
d_ 



lnTriE{iC^r')E{C^)) 
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> 



Tr{E{{C^)-^)EiC^)) 
Tt{E{{C^)-^)E{C^)) 



1/2 



Tr{E{iC^)-^)E{C^)) 

which is bounded below (by a negative number possibly depending on e) uni- 
formly for large values of T by (fOj) and using the fact that both Tr{E{{C^)-^)E{C^)) 
and Tic{E({Cj<)~^)E(Cj^)) have the same order. 



Similary, to get an upper bound, consider 
^Tv {e{{C^)-')E{G_ 
= -Tt(^e(^{C^)-' 

+Tr (e{{C^)-')E 

< 2E 



Jo 



T fT 



Jo 







+2E 

< E 
+2E 



Tr((C7^)-^i?(C7f)) 



1/2 



du 



1/2 



{Y.^j{E{{c^^)-')m) iY^ymc^r')){Y:) 



1/2 



du 



1/2 



Tr(i?((c^)-i))(c^) Trmc^r'mT) 



1/2 



< e[[Tt{{C^)-'E{C^))] [p + Tt[{C^){C^)-'' 



+2 (Tv [E{iC^)-')E{C^)\y^^ (Xr [Ei{CI^)-^)E{C^ 



1/2 



Therefore, 
d 



< 



-lnTriEiiC^)-')E{C^)) 

^ + 2 



Tr{E{{C^)-^)E{CI.)) 



Tt{E{{C^)-^)E{C^)) 
Tt{E{{C^)-^)E{C^)) 



1/2 
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which is bounded above (by a positive number possibly depending on e) 
uniformly for large values of T by ()4.3p . 

Thus, using the similar argument as in (j6.ip we show, since limT^oo'~^iE{{C^)~^)E{C^)) = 
0(1), \imT^ooTr{E{Cj:^)E{CT)) = 0(1). Hence, for eigenvalues of F on 
the left half space, we prove that E{Tv[{Ft - F)E{Ct){Ft - F)'])^/^ = 0(1). 



Case 3: Mixed model. 



In this case, use the decomposition of F as in Section [5l to decompose 
y/M' = {U^ft, U[t). Then, one gets, 

triSxCT^^S'j,) = tr{STM'D'j.{DTMCTM'D'j.)-^DTMS'rr) 

< tr{STM'D'j,DTMS'j)tr{DTMCTM'D'j,)~^ 

< {tr{SoTe'^'o'^e'^''^ S'qt) + triSirCiT'^ S[T))tr{DTMCTM' n 

Since for a symmetric invertible partition matrix. 



K 



E F 
F' H 



with E and H invertible, tr{K) = tr{E - FR-^F')-^ +tr{H - F' E'^ F)-^ . 
Taking E = e'^^^ CoTe'^'o'^ , F = e'^oT jT u^^jj/^^^tc^y"^ and H = I, i.e., 
identity matrix of order pi. Since F converging to zero almost surely by 
the proof of Lemma 15.11 and by the same lemma E converges to B almost 
surely, one obtains tr{D'j'MCTM' D'j^)^^ tr{B^^) + pi almost surely, as 
T — > cx). Therefore, 

E \{tr{e-^^'^ S'^TSoTe-^'o'^) + tr{SiTCiT-^ S[T))tr{DTMCTM' D'^Y^V'^ 
< E{tr{e-^°^ S'oTSoTe~^'o^))E{tr{DTMCTM' D't)-^) 

+E{tr{SiTCiT~^S[T))E{tr{DTMCTM'D'T)-^) 
= Oil) (6.2) 
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by the case 1, and case 2. Similarly, 

tr{{DTMCTM' D'j^)-^DtE{MCtM')D'j~) < trUDTMCrM' D'j,)-^)tr{DTE{MCTM')D'j,) 
and tr{DTE{MCTM')D'j,) = tr{e-^^'^ E{CoT)e-^'<''^) + tr{C^^E{CiT)) ex- 
pectation of which is finite by case 1 and case 2. Therefore one proves, for 
the mixed model, E(Tr[(Fr - F)E{Ct){Ft - F)'])i/2 = , 

Concluding remarks and discussion 

It is easy to see that the state space equation of the general continuous 
autoregressive process (CAR(p)) of the form dXf~^ = apXf + (Xp-iX} + 

is a special case of multidimensional OU processes 

where 



with ai real numbers, cr > and Wt a one-dimensional Browian motion. 
Clearly, A is not singular. However, the RANK condition (a) holds for this 
F and A and, the condition (b') holds for this F. Hence, from our result. 



It is important to observe that this estimation procedure may be the first 
step in developing a test of zero roots of some F, which is necessary to de- 
termine whether univariate processes are co-integrated. Also, if one needs 
to develop a test to determine whether the model for Yt is stationary, it is 
often enough to test whether all eigenvalues of F have negative real parts 
against the alternative that some of them have zero real parts. There- 
fore, one need not often worry about the assumption (b) or (b') for testing 
stationarity. Thus, a related question arises on, whether any Asymptoti- 
cally Mixed Normality property holds for the estimator Ft-, i.e., whether 




the consistency and the asymptotic efficiency of the F of general CAR(p) 



follows. 
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YtYldtY/^{FT - F) follows asymptotically Normal, so that we could 
compute approximate confidence interval for the above testing procedures 
for the necessary parameters in F. As far as we know, these results are 
still unknown. Investigating the Asymptotically Mixed Normality property 
may be an important future direction to consider. One can look into LAMN 
property as well. 

Besides, when the drift coefficient matrix depends on an unknown discrete 
paratmeter which follows a Markov chain (that helps the process to switch 
regimes), finding a consistent and asymptotically efficient estimator becomes 
important. Above questions can be asked in that setup as well. 

In applications, we almost always use discrete sampled data. Similar ques- 
tions can be asked for this model, when the data sampled are in deterministic 
(equal or unequal) time interval or in random interval. That can also be a 
focus of the future direction. 

7 Appendix 

7.1 Purely Imaginary Eigenvalues 

In this Section, we study the asymptotic behavior of OU processes when 
the drift matrix F only contains purely imaginary eigenvalues. The main 
results are summarized in the following: 

THEOREM 7.1 Suppose for the Ornstein-Uhlenbeck process defined in [Ll]) . 
the RANK condition \2. 1\) holds and all the eigenvalues of F are purely imag- 
inary. Let 2p be the dimension of the largest block of the rational canonical 
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form of F as defined in Section\^ (see the Example). Then 

0(Ti/ Vln In T) a.s. ii p = I 
0{T'^p-^/'^^/\n\nT) a.s. if p>2. 
Moreover, 



\\Yt\\ 



V 



0(r2(lnlnr)) 
0{T^P^*{\n\nT)) 



a.s. if p = 1 
a.s. if p > 2. 



To prove Theorem 17. H we need the following Lemmas. 



(7.1) 



LEMMA 7.1 



E 

n=j 



{2n-j)\ 



0(1) if J = 0,1 
0{t^-^) if i > 2. 



Proof. 



E 



(-l)"(t;t)2"-J' 



(2n-j)! 
TT" (J+2)! 



(_l)i/2 |cos(t;t) - 
^ (-l)(i-3)/2|gij^(^^^ _ 

0(1) if i = 0, 1 
Oip-"^) if J > 2. 
Hence, the lemma follows. 



(J+4)! 
cos(ui) 
— sin(t;t) 

1 _ i^tf . 
1 2! 



if i = 

if J = 1 

if j is even, j >2 
(_l)0-i)/2M)rl]| if J- isodd,i>3 



( 1V//2-1 



+ 



r]} 

V-2 



LEMMA 7.2 With the same assumptions as in Theorem 7.1 

0(1) a.s. if p = 1 
Oit^f-'-^) a.s. if p>2. ' 
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Proof. Suppose F is a 2p x 2p matrix and has p eigenvalues of Ai = iv 
and Ai = —iv. Since the characteristic equation for F is = \XI — F\ = 
(A — iv)f{X + iv)P = (A^ + v'^)P, by the Cayley-Hamilton theorem, 



(F^ + v^iy = 0. (7.2) 



Case 1: When p = 1, then F^" = {-l)''v'^'^I and 



e 



' +Fy 

^„ (2n)! ^ V (2n + 1)! 

n=0 ^ ' n=0 ^ ' 

F 

= I cos{vt) -\ sin(ut). (7.3) 

V 

Therefore, Hc'^*!! = 0(1) when p = 1- 

Case 2: When p > 2, then A = F'^ + v'^I is a nilpotent matrix of order p 
by Thus, 



f2 = -v^ 



and 



.i)V"(/-^ + .. . + (-1)^-1' ^ \ ' 



Therefore, 



e 



Let /j(n) = 2n(2n — 1) • • • (2n — j + 1) if j > 1 and /o(?^) = 1- Then, since 
/o(n), /i(n), • • • , /fc(n) are independent, there exist unique Cq, Ci • • • G Z 
such that 



j=0 
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Similarly, let f*(n) = {2n + l)(2n) • • • (2n - j + 2) if j > 1 and f^{n) = 1. 
Then, there exist unique Cq,CI, - ■ ■ £ Z such that 

k 



n ' 



j=0 



By Lemma |7. 11 the first term of (|7.4|) can be expressed as 



n=0 



(2n!) 



(/9-l)An 

E 

fc=0 



E 

fc=0 

e' 



A:=0 



E (-1)' 

fc=0 

(2^^)! 

/ oo 

E E 



oo 

E 

n=k 
k 



U\ A'' 




\k J v^^ 








Ec./.w 


\j=o 







j=0 



\n=k 



(2n-i)! 
S (-^)'xO(t) for p = 2 



k=0 

i;^(-^)'xO(t2fc-2) for p>3 

0{t) for p = 2 
0(t2p-4) for p > 3_ 



Similarly, the second term of (j7.4p can be expressed as 

oo T?2n^2n+1 

FY. 



- (2n + l)! 



E 



fc=0 

fc / oo 

E E ■ 

j=0 \n=fc 



n\ A'' 
(2n-j + l)! 



P-l / 4 N A: 
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Hence, the Lemma follows. 



LEMMA 7.3 



Proof. Let = /(^(t — s)^AdWs, which is a square integrable martin- 
gale for [0 < n < t] and < M >„= J^{t - s)^''AA'ds = - {t - 
u)2k+i^AA'/{2k + 1). Since M„ = -B<a/>„ by Karatzas and Shreve ([l3] 
pl74), 

/ (T - s)''AdWs = 0{BT2k+i) = 0{T''+^/'^Vh[wT). 
Jo 

Hence, the lemma follows. ■ 

Proof of Theorem 17.11 If p = 1, then there exist C ^ TZ such that 
||e-^*|| < C by (I73D. Therefore, 

lly^ll = ||e^^yo+ r e^^^-'^AdWsW < CYq+C [o(VT In In T)1 = 0(VT In In T). 
Jo L -I 

For p > 2, by Lemma [7^ and [73| 

lly^ll = ||e^^yo+ re^^^-^^AdWsW 
Jo 

< O I Ile^^l_,, „ 

k=0 

2p-3 



>o|| + ||/ Y.Ck{T-s)''AdWs 

^0 k=0 

O [||e^^yo|| + || E Ck j\T-sfAdWs 



k=0 



\ k=0 



To show ()7.ip . we have 

Xra.. U^YtY^dtj = 0(tYj\tYldt 
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o{ I WYtW^dt 



0(r2(lnlnr)) a.s. if p = 1 
0{T^P-^ (InlnT)) a.s. if p > 2. 



Hence, the proof of the theorem. 



7.2 Zero Eigenvalues 

In this Section, we study the asymptotic behavior of the OU processes when 
the drift matrix F contains only zeros eigenvalues. (i.e., F is a nilpotent 
matrix.) The main results are summarized in the following: 



THEOREM 7.2 Suppose for the OU process defined in [Tl]) . the RANK 
condition \2. 1\) holds and, all eigenvalues of F are zeros. Let 7 he the di- 
mension of the largest block of the rational canonical form of F as defined 
in Section\^ (i.e., F"' = 0; see the Example). Then 

\\Yt\\ = 0{T'^-'^/'^Vh[hPT) a.s. 

Moreover, 

Xra..(^J^ YtY^dt^ =0{T^^ln\nT)) a.s. (7.5) 

Proof. Since F is a k x k nilpotent matrix of order 7 (1 < 7 < fc), then 
FT = and 

7~1 Tprij-n 

e- = E ^ = Oit--^ 

n=0 



\\Yt\\ < o(\\e''^Yo\\+ rj2Ck{T-s)''AdW, 

\ -^0 k=0 
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0{\\e^^Yo\\)+o\^CkJ^ {T-s)'^AdW, 



To prove ((LS 



Amax (^J^YtY^dt^ = O (rvJ^YtY^dt^ = O (^J^WYtW^dt^ = 0{T^^ {InlnT)). 
Hence, the proof. ■ 
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